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(54) Information processing method and apparatus therefor. 

(57) Disclosed is an information processing 
method of generating image data and ad- 
ditional data paired with the image data and 
capable of searching image data at high speed. 
Photographic time at which image data is 
photographed is compared with a predeter- 
mined time range (S1, S2, S3, S4). Event infor- 
mation corresponding to the predetermined 
time range in which its photographic time is 
included is added to the image data (S5) and 
stored. An image data search operation is per- 
formed on the basis of the stored event infor- 
mation. 
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The present invention relates to an information 
processing method of recording and reproducing 
electronic information and an apparatus therefor. 

In conventional photography using a silver salt 
film, along with developments of camera techniques s 
including automatic focus control (AF) and automatic 
exposure control (AE), a photograph intended by a 
photographer has been able to be taken with an easy 
operation. To search a desired photograph from the 
photographs taken by the photographer, it is impor- 10 
tant that the photographs taken by the photographer 
are properly filed so as to determine easy access to 
the desired photograph. This filing entirely depends 
on the efforts of the photographer. 

More specifically, even if there are a large num- 15 
ber of excellent photographs which reflect the will of 
the photographer, improper filing may hoard these 
photographs. No drastic countermeasures for filing 
photographs have been made in the conventional 
photographic system using silver salt films, except for 20 
a simple countermeasure such as date imprinting. 
For this reason, the photographer must file his pho- 
tographs in an album or the like and record the con- 
tents of the photographs, resulting in cumbersome 
operations. 25 

No system improvement has been made to solve 
the above problem even in an electronic still camera 
for recording a photograph as an electrical signal on 
a floppy disk. Information added to image information 
includes the date, the serial number, and the like. For 30 
this reason, the photographic contents must be de- 
scribed in the recorded floppy disk and managed. 
These data added to the image information are super- 
posed on analog signals serving as image data. To re- 
write these data or add new data, the image data itself 35 
must also be rewritten to require a large circuit size. 
In addition, it is impossible to access these data in a 
search mode. It is, therefore, difficult to perform a 
high-speed search operation. 

In recent years, an electronic still camera for re- 40 
cording a photograph as a digital signal in a memory 
card is proposed and put into practical use. In this still 
camera, data for searching a photographed image 
can be added easier than in the conventional system. 
An embodiment disclosed in Japanese Patent Laid- 45 
Open No. 4-70735 proposes a method of managing 
and searching image data. 

In this method, any one of a photographic date, a 
photographic place, weather, a name of person, a 
portrait, an event, and audio data is recorded as im- so 
age search data together with image data. The image 
search data can be input together with the image data 
automatically or by the photographer upon comple- 
tion of photography. Subsequently, a data type 
(search key) is designated. When this data is input, an ss 
image having data whose contents are identical to 
those of the input data is searched. For example, if a 
person is designated and "Yoshida" is input, an image 
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having portrait data representing a person "Yoshida" 
is searched and output If time is designated, and a 
specific moment is input, an image having the specif- 
ic moment as the data is searched and output 

In consideration of personal use, the most effec- 
tive search key of the above search keys in the search 
mode is the event key representing that a photograph 
is taken in a "field day", a °golf course 0 , or the like. No 
general method of inputting event data is described in 
the above prior art As a special case, there is descri- 
bed a method of transmitting the above data in only 
a limited case by means of an electric wave and caus- 
ing a camera to receive and automatically record the 
electric wave as image data. In this case, the appli- 
cation range of the camera is undesirably limited. 

The present invention has been made in view of 
the conventional problems described above, and has 
as one object to provide an information equipment, 
capable of filing photographed images during photog- 
raphy, recording management data, and efficiently 
searching a photographed image. 

According to the present invention, there is pro- 
vided an information processing method comprising: 
an input step of inputting first data; and 
a step of storing predetermined third data and 
the first data input in the input step so as to associate 
the predetermined third data with the first data when 
second data associated with the first data input in the 
input step is identical to the predetermined third data, 
wherein the first data is searched on the basis 
of the stored third data. 

In another aspect, the invention provides an infor- 
mation processing method comprising: 

an input step of inputting first data; and 
a step of storing predetermined third data and 
the first data input in the input step so as to associate 
the predetermined third data with the first data when 
second data associated with the first data input in the 
input step is included in a category of the predeter- 
mined third data, 

wherein the first data is searched on the basis 
of the stored third data. 

In yet another aspect the invention provides an in- 
formation processing method comprising: 

an input step of inputting first data; and 
a step of storing predetermined fourth data as- 
sociated with predetermined third data and the first 
data input in the input step so as to associate the pre- 
determined fourth data with the first data when sec- 
ond data associated with the first data input in the in- 
put step is identical to the predetermined third data, 
wherein the first data is searched on the basis 
of the stored fourth data. 

In yet another aspect the invention provides an in- 
formation processing method comprising: 

an input step of inputting first data; and 
a step of storing predetermined fourth data as- 
sociated with predetermined third data and the first 
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data input in the input step so as to associate the pre- 
determined fourth data with the first data when sec- 
ond data associated with the first data input in the in- 
put step is included in a category of the predeter- 
mined third data, 5 

wherein the first data is searched on the basis 
of the stored fourth data. 

According to one embodiment, the foregoing ob- 
ject is attained by providing an information processing 
apparatus comprising: 10 
input means for inputting first data; and 
means for storing predetermined third data and 
the first data input by said input means so as to as- 
sociate the predetermined third data with the first 
data when second data associated with the first data 15 
input by said input means is identical to the predeter- 
mined third data, 

wherein the first data is searched on the basis 
of the stored third data. 

In another embodiment of the invention, the fore- 20 
going object is attained by providing an information 
processing apparatus comprising: 

input means for inputting first data; and 
means for storing predetermined third data and 
the first data input by said input means so as to as- 25 
sociate the predetermined third data with the first 
data when second data associated with the first data 
input by said input means is included in a category of 
the predetermined third data, 

wherein the first data is searched on the basis 30 
of the stored third data. 

In another embodiment of the invention, the fore- 
going object is attained by providing an information 
processing apparatus comprising: 

input means for inputting first data; and 35 
means for storing predetermined fourth data 
associated with predetermined third data and the first 
data input by said input means so as to associate the 
predetermined fourth data with the first data when 
second data associated with the first data input by 40 
said input means is identical to the predetermined 
third data, 

wherein the first data is searched on the basis 
of the stored fourth data. 

In another embodiment of the invention, the fore- 45 
going object is attained by providing an information 
processing apparatus comprising: 

input means for inputting first data; and 

means for storing predetermined fourth data 
associated with predetermined third data and the first so 
data input by said input means so as to associate the 
predetermined fourth data with the first data when 
second data associated with the first data input by 
said input means is included in a category of the pre- 
determined third data, 55 

wherein the first data is searched on the basis 
of the stored fourth data. 

According to another embodiment, the foregoing 



object is attained by providing an information equip- 
ment including input means for inputting information, 
storage means for storing the input information, and 
management means for selecting and processing the 
information to add associated information, the infor- 
mation equipment processing a second type of infor- 
mation having a first type of information as associat- 
ed information and a third type of information having 
the first type of information as associated informa- 
tion, wherein said management means comprises 
comparison means for comparing the first type of in- 
formation A associated with the third type of informa- 
tion with the first type of information B associated 
with the second type of information, and when a com- 
parison result from said comparison means repre- 
sents that the information A is identical to the informa- 
tion B or the information A is included in the informa- 
tion B, the second type of information is added to the 
associated information of the third type of informa- 
tion. 

Other features and advantages of the present in- 
vention will be apparent from the following descrip- 
tion taken in conjunction with the accompanying 
drawings, in which like reference characters desig- 
nate the same or similar parts throughput the figures 
thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorpo- 
rated in and constitute a part of the specification, il- 
lustrate embodiment of the invention and, together 
with the description, serve to explain the principles of 
the invention. 

Fig. 1 is a perspective view showing an overall 

apparatus according to an embodiment; 

Fig. 2 is a sectional view of the apparatus shown 

in Fig. 1; 

Fig. 3 is a view showing a display example of a 
liquid crystal display device of the embodiment 
shown in Fig. 1; 

Fig. 4A is a view for explaining a schedule data 
structure of the embodiment shown in Fig. 1; 
Fig. 4B is a view for explaining a schedule data 
structure of the embodiment shown in Fig. 1; 
Fig. 4C is a view for explaining a schedule data 
structure of the embodiment shown in Fig. 1; 
Fig. 5A is a view showing a display example of the 
liquid crystal display device of the embodiment 
shown in Fig. 1; 

Fig. 5B is a view showing a display example of the 
liquid crystal display device of the embodiment 
shown in Fig. 1; 

Fig. 6A is a view showing a display example of the 
liquid crystal display device of the embodiment 
shown in Fig. 1; 

Fig. 6B is a view showing a display example of the 
liquid crystal display device of the embodiment 
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shown in Fig. 1 ; 

Fig. 6C is a view showing a display example of the 
liquid crystal display device of the embodiment 
shown in Fig. 1; 

Fig. 7A is a diagram showing the arrangement of 5 
a comparison unit for adding information of the 
embodiment shown in Fig. 1; 
Fig. 7B is a flow chart showing the operation al- 
gorithm of the comparison unit shown in Fig. 7A; 
Fig. 8A is a view for explaining an image data 10 
structure of the embodiment shown in Fig. 1; 
Fig. 8B is a view for explaining an image data 
structure of the embodiment shown in Fig. 1; 
Fig. 9A is a view showing a display example of the 
liquid crystal display device of the embodiment in is 
Fig. 1; 

Fig. 9B is a view showing a display example of the 
liquid crystal display device of the embodiment in 
Fig. 1; 

Fig. 9C is a view showing a display example of the 20 
liquid crystal display device of the embodiment in 
Fig. 1; 

Fig. 9D is a view showing a display example of the 

liquid crystal display device of the embodiment in 

Fig. 1; 25 

Fig. 10 is a block diagram showing a circuit for 

controlling the apparatus in Fig. 1; 

Fig. 11 A is a view showing underlined data in the 

associted data display screen shown in Fig. 5A; 

Fig. 11 B is a view showing an image data related 30 

to "Inoue"; and 

Fig. 12 is a view showing another display exam- 
ple of Fig. 9B. 



DESCRIPTION OF THE PREFERRED 
EMBODIMENT 



35 



Preferred embodiments of the present invention 
will be described in detail in accordance with the ac- 
companying drawings. aq 

Fig. 1 is a perspective view showing the overall 
apparatus of an embodiment, Fig. 2 is a sectional 
view thereof, and Fig. 10 is a block diagram of an elec- 
tric circuit. Reference numeral 1 denotes a notebook 
type electronic camera apparatus of an embodiment. 45 
The camera apparatus 1 comprises a camera body 3 
and an upper lid 5. The camera body 3 is mechanically 
and electrically connected to the upper lid 5 through 
a hinge 4 by means of a known mechanism. A switch 
(not shown) is arranged in the hinge 4. The so 
open/closed state of the upper lid 5 can be detected 
by the hinge 4. Various kinds of cards can be mounted 
in a card slot 9. New functions can be added to the 
camera body 3 in accordance with the contents of 
ROMs incorporated in the respective cards. That is, 55 
if a memory card MC incorporating an image record- 
ing memory and a camera control CPU is mounted in 
the card slot 9, the camera body 3 serves as an elec- 



tronic camera. 

The functions of the camera body in which the 
memory card MC is mounted will be described below. 

The interior of the camera body 3 is arranged, as 
shown in Fig. 2. Reference numeral 2 denotes a pho- 
tographic unit The photographic unit 2 comprises a 
CCD 22 for photoelectrically converting an object im- 
age focused by a photographic lens 21 , a diaphragm 
shutter 25, a low-pass filter 28, and an infrared cut fil- 
ter 30. Reference numeral 31 denotes a focus control 
knob formed on a member for holding the photograph- 
ic lens. When the focus control knob is vertically slid 
in Fig. 2, a distance between the photographic lens 21 
and the CCD 22 is changed to perform focus control. 
The photographic unit is a known means, and a de- 
tailed description thereof will be omitted. 

A signal extracted as an electrical signal by the 
photographic unit 2 is sampled by a known signal 
processing circuit 40 to obtain a video signal dis- 
played on a liquid crystal display device 7 or data re- 
corded in a memory 51 in the memory card MC. The 
signal processing circuit 40 also performs signal proc- 
essing, e.g., processing for reproducing a video signal 
from the memory information to display video infor- 
mation recorded in the memory 51 on the liquid crys- 
tal display device 7. 

The liquid crystal display device 7 displays vari- 
ous kinds of information. When the camera body 
serves as an electronic still camera, the liquid crystal 
display device 7 serves as an electronic viewfinder 
(EVF) as shown in Figs. 6A, 6B, and 6C to display a 
currently photographed image. A known electrostatic 
switch 44 is arranged on the display screen of the liq- 
uid crystal display device. When a pen (not shown) is 
brought into contact with the screen, the contact pos- 
ition on the screen is detected. 

Reference numeral 15 denotes a release button 
for generating a photography start trigger; and 18, a 
power switch for ON/OF F-cont rolling the power sup- 
ply of the camera body. A panel switch group 17 (Fig. 
1) is arranged on the inner surface of the upper lid 5 
and can be operated while the hinge 4 is set in an 
open state. Part of the panel switch group 17 is used 
for an electronic notebook function incorporated in a 
ROM 41 of the camera body, and the remaining part 
of the panel switch group 1 7 has functions changed 
depending on the types of cards mounted in the card 
slot 9. 

The camera body 3 has a CPU 45, while the 
memory card MC has a CPU 50. 

The CPU 50 controls the photographic unit 2, the 
signal processing circuit 40, the memory 51, and the 
like and performs the above camera operations. 

The operations of the release button 1 5, the pow- 
er switch 18, and the panel switch group 17 are de- 
tected by the CPU 45 in the camera body, and detec- 
tion signals are transmitted to the CPU 50 in the 
memory card MC. 
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A built-in clock 43 for managing time is arranged 
in the camera body 3. As electronic notebook func- 
tions, a schedule function and a data management 
function for a telephone number, an address, and the 
like are prepared in the ROM 41 of the camera body. s 
These programs are executed by the CPU 45 in the 
camera body 3. 

The schedule and data (e.g., a telephone number 
and an address) are stored in a data memory 42 in the 
camera body 3. 10 

Functions such as the schedule function which 
are associated with the present invention will be de- 
scribed below. Other functions can be constituted by 
known techniques, and a detailed description thereof 
will be omitted. 15 

The operation of the schedule function of the ap- 
paratus of this embodiment will be described below. 
Fig. 3 shows the display screen of a schedule table of 
the liquid crystal display device 7 of this embodiment 
with reference to an example on January 22, 1 993. In 20 
this display, a golf is scheduled from 8:00 to 1 7:00 on 
January 22, 1993, and a party is scheduled from 
1 7:00 to 19:00. The current time obtained by the built- 
in clock is always displayed in an upper portion 7a of 
the liquid crystal display device 7. 25 

Figs. 4A, 4B, and 4C are views for explaining 
schedule data. Fig. 4A shows the data structure of the 
schedule data. A schedule [n] consists of data m rep- 
resenting the number of included data and data (data 
type and contents). Fig. 4C shows an example of the 30 
contents of the schedule data shown in Fig. 3. Schedule 
[1] has seven data as associated data, i.e., event data 
"golf, time data "1 993/01/22/08/00 -1 993/01/22/1 7/00", 
person data "Yoshida", "Inoue", and "Goto", place 
data "ABC Gold Club", and other data "appointment: 35 
6 o'clock, Shibuya". This data structure is illustrated 
in Fig. 4B. Similarly, as shown in Fig. 4B, schedule [2] 
has the following associated data: event data "party", 
time data "1993/01/22/17/00 -1993/01/22/19/00", 
person data "Yoshida", "Inoue", "Goto", "Arai", "Yama- 40 
moto", "Hamada", and "Aoyama", and place data 
"ABC Golf Club". 

Numbers (data types) "0", "1", "2", "3", "4" follow- 
ing the above data represent the following data types 
respectively representing an event, time, a person, a 45 
place, and other data. When an input pen (not shown) 
is brought into contact with (to be referred to as "is op- 
erated at" hereinafter) a portion "golf" on the display 
screen in Fig. 3, the associated data is displayed, as 
shown in Fig. 5A. When the input pen is operated at so 
a portion "party" on the screen, the associated data 
is displayed, as shown in Fig. 5B. 

The above schedule function is executed by the 
CPU 45 in the camera body 3. 

The operation of the camera function of the ap- 55 
paratus of this embodiment will be described below. 

Fig. 6A shows the display screen of the liquid 
crystal display device 7 when the camera function is 



used. The liquid crystal display device 7 serves as an 
electronic viewfinder (EVF) for displaying images 
continuously photographed by an image pickup de- 
vice. In addition, the current time counted by the built- 
in clock is displayed in the upper portion 7a of the liq- 
uid crystal display device 7. When a release switch is 
depressed in this state, the corresponding image is 
stored and recorded in the memory of the memory 
card MC. 

At this time, the photographic time, i.e., 13:28, 
January 22, 1993 at which photography is performed 
as shown in Fig. 6B is automatically read by the CPU 
45, transmitted to the CPU 50, and automatically re- 
corded as associated data. 

Schedule information is referred to to determine 
whether event data can be added. Fig. 7A is a view 
showing the function of a comparison unit C arranged 
in the CPU 45 of the camera body 3. The comparison 
unit C receives information A and information B and 
outputs the inclusion relation of these pieces of infor- 
mation. More specifically, when the contents of the 
information A are identical to those of the information 

B, the comparison unit C outputs "1". When the con- 
tents of the information A are included in those of the 
information B, the comparison unit C outputs "2"; 
otherwise, the comparison unit C outputs "3". Proc- 
essing associated with addition of event data will be 
described with reference to a flow in Fig. 7B. 

In step S1, photographic time (in this case, 13:28, 
January 22, 1993) is input to the information A (i.e., 
information A = "1993/01/22/13/28") . In step S2, n = 
1 is set In step S3, schedule time data is input to the 
information B. In step S4, the information A is com- 
pared with the information B by the comparison unit 

C. In schedule [1] shown in Fig. 4B, the information B 
is "1993/01/22/08/00 -1993/01/22/17/00", so that the 
information A is included in the information B. For this 
reason, the comparison result becomes "2". In step 
S5, an event "golf" is added as data associated with 
the image. In schedule [2] in Fig. 4B, since the infor- 
mation B is "1993/01/22/17/00 - 1993/01/22/19/00", 
the information A is not associated with the informa- 
tion B. For this reason, the comparison result be- 
comes "3". In this case, the event is not added. In 
steps S6 and S7, loop control is performed to com- 
pare all the schedule data, and events are appro- 
priately added. 

The image data received by the apparatus 1 of 
this embodiment and the above additional informa- 
tion are stored in the memory 51 or the data memory 
42. The stored data are referred to by a processing 
method to be described below. 

The flow shown in Fig. 7B is executed by the CPU 
45 in the camera body 3. The event information addi- 
tion (S5) is performed such that event information to 
be added is transmitted from the CPU 45 to the CPU 
50 in the memory card MC and the CPU 50 adds the 
event data to the corresponding image data and re- 
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cords the resultant data. 

For example, when the input pen (not shown) is 
operated at a display screen portion "person" in Fig. 
6B and a name of person (in this case, "Yoshida") is 
input, it can be recorded as associated data, as shown 
in Fig. 6C. When the input pen is operated at a display 
screen portion "place", and a name of place (in this 
case, "ABC Golf Club") is input, it can be recorded as 
associated data, as shown in Fig. 6C. In addition, 
when the input pen is operated at the "other data", and 
data is input, it can be recorded as associated data. 

These processes are performed such that the 
CPU 45 in the camera body 3 detects the pres- 
ence/absence of an operation, recognizes informa- 
tion to be added, and transmits it to the CPU 50 in the 
memory card MC, and the CPU 50 adds the additional 
data to the corresponding image data. 

In the data structure of the above photographed 
image, as shown in Fig. 8A, an image [n] comprises 
data m representing the number of included data, 
data (data type and contents), and image data. An im- 
age shown in Fig. 6C has the following associated 
data: event data "golf", time data "1993/01/22/13/28", 
person data "Yoshida", and place data "ABC Golf 
Club". The data of image [1] can be illustrated, as 
shown in Fig. 8B. 

A search process for image data with additional 
information generated by the apparatus of this em- 
bodiment will be described below. 

Fig. 11 A shows underlined data in the associated 
data display screen shown in Fig. 5A. The underlined 
data (e.g., "Inoue") indicates the presence of image 
data having data having the same contents (i.e., data 
"Inoue") as those of the underlined data as the asso- 
ciated data. For this reason, for example, when a por- 
tion "Inoue" is operated, the latest data is selected 
from the image data having "Inoue" as the associated 
data and is displayed (Fig. 11 B). In addition, a search 
operation along the time axis can be performed using 
arrow keys in an upper right portion 7b. 

When a command for displaying schedule data of 
January 22, 1993 is input from the panel switch group 
1 7, the above image data with the additional informa- 
tion is searched, and a corresponding schedule table 
is displayed. As shown in Fig. 9A, to check a schedule 
screen display as a past schedule display, i.e., to 
check a schedule table of January 22 on January 24, 
an "image search" key is displayed in an upper right 
portion 7b of the liquid crystal display device 7. When 
this key is operated, a display shown in Fig. 9B ap- 
pears. In this display, there are underlined data (e.g., 
"golf"). This indicates the presence of image data hav- 
ing time data included in the time data of the data 
"golf". For example, assume that a screen portion 
"golf" is operated. Since the data "golf has time data 
"1993/01/22/08/00 -1993/01/22/17/00" as associated 
data, images having time data included in the time 
data of the data "golf are searched and displayed 



from an image closest to "1993/01/22/08/00" (Fig. 
9D). At this time, a search operation along the time 
axis can be performed using arrow keys in the upper 
right portion 7b. For example, if a photographer men> 

5 orizes the date at which he played golf, an image can 
be efficiently searched by the above method. A meth- 
od of searching an image when a photographer for- 
gets the date at which he played golf will be described 
below. In the display state of Fig. 9B, when the pho- 

10 tographer operates the "event" key in the upper right 
portion 7b, event information stored as associated 
data of the image data in the memory card MC is dis- 
played (Fig. 9C). When the event data "golf" is oper- 
ated, images having the data "golf" as associated in- 

15 formation are searched and displayed from the latest 
one (Fig. 9D). At this time, a search operation along 
the time axis can also be performed using the arrow 
keys in the upper right portion 7b. 

In the display state shown in Fig. 9B t when one 

20 of the "person" key, "place" key, and "other data" key 
in the upper right portion 7b is operated, a list of per- 
son information, place information, and other infor- 
mation stored as the associated data of the image 
data in the memory card MC are displayed in accor- 

25 dance with the operated search key. When given in- 
formation "X" is operated in the list, images having the 
information "X" as the associated information are 
searched and displayed from the latest one. 

These processes are also executed by the CPU 

30 45 in the camera body 3. However, the CPU 50 per- 
forms read access to data stored in the memory card 
MC and sends necessary data to the signal process- 
ing circuit 40 and the CPU 45 in the camera body 3. 
The display screen in Fig. 9B may be displayed, 

35 as shown in Fig. 12. When the "person" key in the up- 
per right portion 7b is operated in Fig. 12, data indi- 
cating the presence of image data having the same 
person data as that having this data (e.g., "golf") is un- 
derlined and displayed (in this case, "party"). When 

40 a portion "golf* is operated, images having, as the as- 
sociated data, the person data "Yoshida", "Inoue", 
and "Goto" having data "golf are searched and dis- 
played from the one closer to the time 
"1993/01/22/08/00 - 1993/01/22/17/00" (Fig. 9D). At 

45 this time, a search operation can be performed along 
the time axis using the arrow keys in the upper right 
portion 7b. 

In this manner, when the "person" key is operated 
as the search data, and data is input as "golf", person 

so data having the data "golf as the associated data can 
be referred to and searched. For this reason, the 
search condition is an AND product of "golf and "per- 
son", thereby efficiently searching the data. In this 
case, the search operation can be performed without 

55 memorizing a name of person. 

The same operation as described above is per- 
formed in the state of Fig. 12 upon operations of the 
"location" key and "other data" key in the upper right 
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portion 7b. 

Black marks 7d along a time axis 7c indicate 
schedule data representing periods during which im- 
age photography has been performed. When each 
mark 7d is operated, the corresponding images can 
be searched and displayed. Therefore, when a por- 
tion of about "13:00° in the black mark in Fig. 12 is op- 
erated, the image in Fig. 9D is searched. 

Note that a method of performing a search oper- 
ation using the "event", "person", "place", or "other 
data" key can be practiced without the schedule func- 
tion (i.e., the function for displaying time and events 
in a table). 

The image data and the corresponding additional 
information which are generated by the apparatus of 
this embodiment are recorded in the memory of the 
memory card MC. This serves as a very effective 
means when the memory card MC is subjected to a 
search operation by another search unit or the image 
data in the memory card MC are to be copied in a 
large-capacity recording unit and searched. 

In the even information addition process shown in 
Fig. 7B, the information A is photographic time (date). 
However, the information A is not limited to this. For 
example, any information associated with a photo- 
graphed image, such as a name of photographer and 
a name of photographic place may be used. If the in- 
formation A is a name of photographer, a group name 
to which a plurality of photographers belong is as- 
signed to the information B. If a name of photographer 
is included in the category of a predetermined group 
name (in the process of the comparison unit in Fig. 
7A), this group name is added to the photographed 
image data and is stored. If the information A is a pho- 
tographic place, a predetermined wider area to which 
a plurality of photographic places is assigned to the 
information B. If a photographic place is included in 
the category of the predetermined area (in the proc- 
ess of the comparison unit in Fig. 7A), this area name 
is added to the photographed image data and stored. 

As has been described above, according to the 
present invention, an information equipment for proc- 
essing a second type of information having a first 
type of information as associated information, and a 
third type of information having the first type of infor- 
mation as the associated information comprises a 
comparison means for comparing the first type of in- 
formation A associated with the third type of informa- 
tion with the first type of information B associated 
with the second type of information. If a comparison 
result from the comparison unit represents that the in- 
formation A is identical to the information B or the in- 
formation A is included in the information B, the sec- 
ond type of information is added to the associated in- 
formation of the third type of information. During pho- 
tography, information for searching a photographed 
image can be automatically added, and therefore the 
recorded photographed image can be easily search- 



ed. 

Assume photography is performed at given time 
in an information equipment for processing schedule 
information having time data as associated data and 

5 image information having photographic time as asso- 
ciated data. In this case, if schedule information rep- 
resenting the same time as the given time or including 
the given time is present, this schedule data is added 
to the photographed image information as associated 

10 data, so that the photographic contents can be lab- 
eled simultaneously with photography, thereby facili- 
tating the subsequent image search operation. 

The above embodiment of the present invention 
has exemplified a notebook type electronic camera 

15 which integrally includes a photographic function, a 
schedule function, a search function, and a reproduc- 
tion function. However, these functions need not be 
integrally included to obtain the same effect as descri- 
bed above if a combination of these functions falls 

20 within the scope of the appended claims. 

As many apparently widely different embodi- 
ments of the present invention can be made without 
departing from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the spe- 

25 cific embodiments thereof except as defined in the 
appended claims. 



Claims 

30 

1. An information processing method comprising: 

an input step of inputting first data; and 
a step of storing predetermined third data 
and the first data input in the input step so as to 
35 associate predetermined third data with the first 

data when second data associated with the first 
data input in the input step is identical to the pre- 
determined third data, 

wherein the first data is searched on the 
40 basis of the stored third data. 

2. The method according to claim 1, wherein the 
first data is image data. 

45 3. The method according to claim 2, wherein the 
second data represents time at which the first 
data is input in the input step. 

4. The method according to claim 2, wherein the 
so second data represents a name of person who in- 
puts the first data in the input step. 

5. The method according to claim 2, wherein the 
second data represents a place at which the first 

55 data is input in the input step. 

6. An information processing method comprising: 

an input step of inputting first data; and 
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a step of storing predetermined third data 
and the first data input in the input step so as to 
associate the predetermined third data with the 
first data when second data associated with the 
first data input in the input step is included in a s 
category of the predetermined third data, 

wherein the first data is searched on the 
basis of the stored third data. 

7. The method according to claim 6, wherein the 10 
first data is image data. 

8. The method according to claim 6 f wherein the 
second data represents time at which the first 
data is input in the input step, and is 

the third data represents a predetermined 
time interval. 

9. The method according to claim 6, wherein the 
second data represents a name of person who in- 20 
puts the first data in the input step, and 

the third data represents a name of group 
to which a predetermined name of person be- 
longs. 

25 

10. The method according to claim 6, wherein the 
second data represents a place at which the first 
data is input in the input step, and 

the third data represents a name of area to 
which a predetermined place belongs. 30 

11. An information processing method comprising: 

an input step of inputting first data; and 
a step of storing predetermined fourth data 
associated with predetermined third data and the 35 
first data input in the input step so as to associate 
the predetermined fourth data with the first data 
when second data associated with the first data 
input in the input step is identical to the predeter- 
mined third data, 40 

wherein the first data is searched on the 
basis of the stored fourth data. 

12. The method according to claim 11, wherein the 

first data is image data. 45 

13. The method according to claim 12, wherein the 
second data represents time at which the first 
data is input in the input step. 

50 

14. The method according to claim 12, wherein the 
second data represents a name of person who in- 
puts the first data in the input step. 

15. The method according to claim 12, wherein the ss 
second data represents a place at which the first 
data is input in the input step. 



16. The method according to claim 12, wherein the 
fourth data is event data associated with the third 
data. 

17. An information processing method comprising: 

an input step of inputting first data; and 
a step of storing predetermined fourth data 
associated with predetermined third data and the 
first data input in the input step so as to associate 
the predetermined fourth data with the first data 
when second data associated with the first data 
input in the input step is included in a category of 
the predetermined third data, 

wherein the first data is searched on the 
basis of the stored fourth data. 

18. The method according to claim 17, wherein the 
first data is image data. 

19. The method according to claim 17, wherein the 
second data represents time at which the first 
data is input in the input step, and 

the third data represents a predetermined 
time interval. 

20. The method according to claim 17, wherein the 
second data represents a name of person who in- 
puts the first data in the input step, and 

the third data represents a name of group 
to which a predetermined name of person be- 
longs. 

21. The method according to claim 17, wherein the 
second data represents a place at which the first 
data is input in the input step, and 

the third data represents a name of area to 
which a predetermined place belongs. 

22. The method according to claim 17, wherein the 
fourth data is event data associated with the third 
data. 

23. An information processing apparatus comprising: 

input means for inputting first data; and 
means for storing predetermined third data 
and the first data input by said input means so as 
to associate the predetermined third data with the 
first data when second data associated with the 
first data input by said input means is identical to 
the predetermined third data, 

wherein the first data is searched on the 
basis of the stored third data. 

24. The apparatus according to claim 23, wherein the 
first data is image data. 

25. The apparatus according to claim 23, wherein the 
second data represents time at which the first 
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data is input by said input means. 

26. The apparatus according to claim 23, wherein the 
second data represents a name of person who in- 
puts the first data by said input means. 5 

27. The apparatus according to claim 23, wherein the 
second data represents a place at which the first 
data is input by said input means. 

10 

28. An information processing apparatus comprising: 

input means for inputting first data; and 
means for storing predetermined third data 
and the first data input by said input means so as 
to associate the predetermined third data with the 15 
first data when second data associated with the 
first data input by said input means is included in 
a category of the predetermined third data, 

wherein the first data is searched on the 
basis of the stored third data. 20 

29. The apparatus according to claim 28, wherein the 
first data is image data. 



30. The apparatus according to claim 28, wherein the 
second data represents time at which the first 
data is input by said input means, and 

the third data represents a predetermined 
time interval. 



25 



30 



31. The apparatus according to claim 28, wherein the 
second data represents a name of person who in- 
puts the first data by said input means, and 

the third data represents a name of group 
to which a predetermined name of person be- 35 
longs. 

32. The apparatus according to claim 28, wherein the 
second data represents a place at which the first 
data is input by said input means, and 40 

the third data represents a name of area to 
which a predetermined place belongs. 

33. An information processing apparatus comprising: 

input means for inputting first data; and 45 
means for storing predetermined fourth 
data associated with predetermined third data 
and the first data input by said input means so as 
to associate the predetermined fourth data with 
the first data when second data associated with so 
the first data input by said input means is identical 
to the predetermined third data, 

wherein the first data is searched on the 
basis of the stored fourth data. 

55 

34. The apparatus according to claim 33, wherein the 
first data is image data. 



35. The apparatus according to claim 33, wherein the 
second data represents time at which the first 
data is input by said input means. 

36. The apparatus according to claim 33, wherein the 
second data represents a name of person who in- 
puts the first data by said input means. 

37. The apparatus according to claim 33, wherein the 
second data represents a place at which the first 
data is input by said input means. 

38. The apparatus according to claim 33, wherein the 
fourth data is event data associated with the third 
data. 

39. An information processing apparatus comprising: 

input means for inputting first data; and 
means for storing predetermined fourth 
data associated with predetermined third data 
and the first data input by said input means so as 
to associate the predetermined fourth data with 
the first data when second data associated with 
the first data input by said input means is included 
in a category of the predetermined third data, 

wherein the first data is searched on the 
basis of the stored fourth data. 

40. The apparatus according to claim 39, wherein the 
first data is image data. 

41. The apparatus according to claim 39, wherein the 
second data represents time at which the first 
data is input by said input means, and 

the third data represents a predetermined 
time interval. 

42. The apparatus according to claim 39, wherein the 
second data represents a name of person who in- 
puts the first data by said input means, and 

the third data represents a name of group 
to which a predetermined name of person be- 
longs. 

43. The apparatus accord ing to claim 39, wherein the 
second data represents a place at which the first 
data is input by said input means, and 

the third data represents a name of area to 
which a predetermined place belongs. 

44. The apparatus according to claim 39, wherein the 
fourth data is event data associated with the third 
data. 

45. An information equipment including input means 
for inputting information, storage means for stor- 
ing the input information, and management 
means for selecting and processing the informa- 
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tion to add associated information, the informa- 
tion equipment processing a second type of infor- 
mation having a first type of information as asso- 
ciated information and a third type of information 
having the first type of information as associated 5 
information, wherein said management means 
comprises comparison means for comparing the 
first type of information A associated with the 
third type of information with the first type of in- 
formation B associated with the second type of 10 
information, and when a comparison result from 
said comparison means represents that the infor- 
mation A is identical to the information B or the in- 
formation A is included in the information B, the 
second type of information is added to the asso- 15 
ciated information of the third type of information. 

46. The equipment according to claim 45, wherein 
the first type of information is time data, and the 
third type of information is image data. 20 

47. A recorder for audio, video and/or still pictures, 
wherein index information is stored electronically 
in association with recorded images or sound, au- 
tomatically by reference to pre-stored schedule 25 
information. 

48. An apparatus according to claim 47 further com- 
prising means for searching by reference to the 
stored index information. 30 

49. A method or apparatus having the features of any 
combination of the preceding claims. 
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FIG. 5A 

JANUARY 20, 1993 (CHANGE) <^ARC 

"GOLF" 

TIME: JANUARY 22, 1993 8:00-17:00 
PERSON: YOSHIDA, INOUE, AND GOTO 7 
PLACE: ABC GOLF CLUB \$ 
APPOINTMENT: 6 O'CLOCK, SHIBUYA 



FIG. 5B 



JANUARY 20, 1993 ( CHANGE ) CjSgi 

"PARTY- 
TIME: JANUARY 22, 1 993 1 7:00-1 9:00 
PERSON: YOSHIDA, INOUE, GOTO, ARAI, 

YAMAMOTO, HAMADA. AND AOYAMA \$ 

PLACE: ABC GOLF CLUB 
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FIG. 11A 
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TIME: 8:00-1 7:00, JANUARY 22, 1993 




PERSON: YOSHIDA. INOUE. AND GOTO 




PLACE: ABC GOLF CLUB 




APPOINTMENT: 6 O'CLOCK, SHIBUYA 
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42266 

Twt^miig md Recall of Capture Hw ciffai 



A 'F*^**^ is described for indexing, and thereby recalling^ digitally captured 
ii^fWr^nfti mn based on location inPi'i p*tt t*^?p wnn iff* Mint ^yffi ? which are fff^proHg ^H l to 
flic user: 

Infufiiifllion (n) on ones) can be captured by a. variety of well known elccUunic means 
- audio recording, contact scanning, digital photography, video, written 
(fonnal/inibrrnfll), keyboard entry, etc* In this method, when an event is captured by 
whichever of the above means is used, the location is also antommicany recorded and 
attached to the stored rn£ozmatxon* Tto oft*^^ Day be *^*t^ri in^iT usmg tochnolo^Qes like 
QPS, crTfnlffr base fftfltiortfl, RF triangulalion, and satdfites. Fftch event is then 
labelled by attaching location and time of capture. It is known to attach time and 
location information to electronic records in this way. 

The method however further involves collection together of aD the records of captured 
infanmnHrm and use of the location and time of capture tags as an index The key user 
benefit is provided in the ways the index can bo used: it is possible to use the indflx 
TnflTrff irpin n***^ iwm^ thereby ^^hft p^wn g flic tsw numeric dffta of the records* J l 
can be achieved by identifying in the Ipcptwrn and time logs common Ift T rJ tf i' ^ g and 
behaviours . Simple heuristics can be used to identify place of work and residence. 
The identity of further regularly visited locations can be obtained by prompting the 
user tor i nPm nfltifln or by looking at the captured c^ffitent for dues* 

specific iti ito iifl ti ft fw n% ^hii^ method are the attachment of location i^f^^rp*V^ n its 
conversion t*^^ a readiry 8ff fl rnl^ib^ ? fi^i Fm , and the uses that can then be rnndc when 
numeric location mfonuation -is converted into a mote familiar, word based, 
description for searching at a later time. 

Methods of transporting the rafhimatton and the methods for puffing together the 
consequent database can be achieved using weflkriown means. 
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